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We study the optimal multiple stopping time problem defined for 
each stopping time S by v{S) = esssup^^ E[tp{Ti, . . . ,Td)\Ts]. 

The key point is the construction of a new reward <f) such that the 
value function v{S) also satisfies v{S) = ess supg>g £[0(^)1 J^s■]. This 
new reward (p is not a right-continuous adapted process as in the 
classical case, but a family of random variables. For such a reward, 
we prove a new existence result for optimal stopping times under 
weaker assumptions than in the classical case. This result is used to 
prove the existence of optimal multiple stopping times for v{S) by 
a constructive method. Moreover, under strong regularity assump- 
tions on if), we show that the new reward (p can be aggregated by 
a progressive process. This leads to new applications, particularly 
in finance (applications to American options with multiple exercise 
times). 

Introduction. The present work on the optimal multiple stopping time 
problem, following the optimal single stopping time problem, involves prov- 
ing the existence of the maximal reward, finding necessary or sufficient con- 
ditions for the existence of optimal stopping times and providing a method 
to compute these optimal stopping times. 

The results are well known in the case of the optimal single stopping time 
problem. Consider a reward given by a right-continuous left-limited (RCLL) 
positive adapted process [4>t)o<t<T on F = (fi, J-", {J^t)o<t<T, P), ^ satisfying 
the usual conditions, and look for the maximal reward 

v{0) = sup{E[(l)r],T€To}, 

where T € ]0,oo[ is the fixed time horizon and Tq is the set of stopping 
times 6 smaller than T. Prom now on, the process {(j)t)o<t<T will be denoted 



Received October 2009; revised June 2010. 

AMS 2000 subject classifications. Primary 60G40; secondary 60G07, 28B20, 62L15. 
Key words and phrases. Optimal stopping, optimal multiple stopping, aggregation, 
swing options, American options. 

This is an electronic reprint of the original article published by the 
Institute of Mathematical Statistics in The Annals of Applied Probability, 
2011, Vol. 21, No. 4, 1365-1399. This reprint differs from the original in 
pagination and typographic detail. 



1 



2 M. KOBYLANSKI, M.-C. QUENEZ AND E. ROUY-MIRONESCU 



by {4>t)- In order to compute v{0), we introduce for each 5 G Tq the value 
function v{S) = esssup{E[(pr\J^s],T & Ts}, where Ts is the set of stopping 
times in Tq greater than S. The value function is given by a family of random 
variables {v{S),S € Tq}. By using the right continuity of the reward {(pt), it 
can be shown that there exists an adapted process (vt) which aggregates the 
family of random variables {v{S),S € Tq} that is such that vs = v{S) a.s. for 
each S € Tq. This process is the Snell envelope of ((/>t), that is, the smallest 
supermartingale process that dominates (p. Moreover, when the reward {(pt) 
is continuous, the stopping time defined trajectorially by 

e{S) = mi{t>S,vt = (l)t} 

is optimal. For details, see El Karoui (1981), Karatzas and Shreve (1998) or 
Peskir and Shiryaev (2006). 

In the present work, we show that computing the value function for the 
optimal multiple stopping time problem 

v{S) = esssup{E'[V'(Ti, . ..,Td)\Ts],Ti, ...,Tde Ts}, 

reduces to computing the value function for an optimal single stopping time 
problem 

u{S) = esssup{E[0(0)|J-5],^ € Ts}, 

where the new reward (p is no longer an ROLL process, but a family {<p{9),9 G 
Tq} of positive random variables which satisfies some compatibility prop- 
erties. For this new optimal single stopping time problem with a reward 
{(p{6),9 € To}, we show that the minimal optimal stopping time for the 
value function u{S) is no longer given by a hitting time of processes, but by 
the essential infimum 

e*{S) := ess inf {6 £Ts,u{9) = (P{e) a.s.}. 

This method also has the advantage that it no longer requires any aggre- 
gation results that need stronger hypotheses and whose proofs are rather 
technical. 

By using the reduction property v{S) = u{S) a.s., we give a method to 
construct by induction optimal stopping times (rj*, . . . ,rj) for v{S), which 
are also defined as essential infima, in terms of nested optimal single stopping 
time problems. 

Some examples of optimal multiple stopping time problems have been 
studied in different mathematical fields. In finance, this type of problem 
appears in, for instance, the study of swing options [e.g., Carmona and 
Touzi (2008), Carmona and Dayanik (2008)] in the case of ordered stopping 
times. In the nonordered case, some optimal multiple stopping time prob- 
lems appear as useful mathematical tools to establish some large deviations 
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estimations [see Kobylanski and Rouy (1998)]. Further applications can be 
imagined in, for example, finance and insurance [see Kobylanski, Quenez 
and Rouy-Mironescu (2010)]. In a work in preparation [see Kobylanski and 
Quenez (2010)], the Markovian case will be studied in detail and some ap- 
plications will be presented. 

The paper is organized as follows. In Section 1 we revisit the optimal 
single stopping time problem for admissible families. We prove the existence 
of optimal stopping times when the family (p is right- and left-continuous 
in expectation along stopping times. We also characterize the minimal opti- 
mal stopping times. In Section 2 we solve the optimal double stopping time 
problem. Under quite weak assumptions, we show the existence of a pair 
of optimal stopping times and give a construction of those optimal stop- 
ping times. In Section 3 we generalize the results obtained in Section 2 to 
the optimal d-stopping-times problem. Also, we study the simpler case of 
a symmetric reward. In this case, the problem clearly reduces to ordered 
stopping times, and our general characterization of the optimal multiple 
stopping time problem in terms of nested optimal single stopping time prob- 
lems straightforwardly reduces to a sequence of optimal single stopping time 
problems defined by backward induction. We apply these results to swing 
options and, in this particular case, our results correspond to those of Car- 
mona and Dayanik (2008). In the last section, we prove some aggregation 
results and characterize the optimal stopping times in terms of hitting times 
of processes. 

Let F = {Q,T,{J-'t)o<t<T,P) be a probability space, where T ^]0,oo[ is 
the fixed time horizon and {J-t)o<t<T is a filtration satisfying the usual 
conditions of right continuity and augmentation by the null sets of 7-" = J-t- 
We suppose that Tq contains only sets of probability or 1 . We denote by Tq 
the collection of stopping times of F with values in [0,T]. More generally, 
for any stopping time S, we denote by Ts the class of stopping times ^Tq 
with S <9 a.s. 

We use the following notation: for real- valued random variables X and X„, 
n € N, the notation "X„ t means "the sequence (X„) is nondecreasing 
and converges to X a.s." 

1. The optimal single stopping time problem revisited. We first recall 
some classical results on the optimal single stopping time problem. 

1.1. Classical results. The following classical results, namely the super- 
martingale property of the value function, the optimality criterium and the 
right continuity in expectation of the value function are well known [see El 
Karoui (1981) or Karatzas and Shreve (1998) or Peskir and Shiryaev (2006)]. 
They are very important tools in optimal stopping theory and will often be 
used in this paper in the (unusual) case of a reward given by an admissible 
family of random variables defined as follows. 
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Definition 1.1. A family of random variables {cl){9),6 G Tq} is said to 
be admissible if it satisfies the following conditions: 

1. for all 9 ^Tq, (f)(9) is an J^^i-measurable M'''-valued random variable; 

2. for all 9,9' G Tq, (t){6) = (t){9') a.s. on {6 = 9'}. 

Remark 1.1. Let {(f)t) be a positive progressive process. The family 
defined by (^(0) = c^g is admissible. 

Note also that the definition of admissible families corresponds to the 
notion of To-systems introduced by El Karoui (1981). 

For the convenience of the reader, we recall the definition of the essential 
supremum and its main properties in Appendix A. 

Suppose the reward is given by an admissible family {(j)[9),9 € Tq}. The 
value function at time S, where 5 G Tq, is given by 

(1.1) v{S) = ess sup E[(l){9)\Ts]. 

e&Ts 

Proposition 1.1 (Admissibility of the value function). The value func- 
tion that is the family of random variables {f (S"), S G Tq} defined by (1-1) is 
an admissible family. 

Proof. Property 1 of admissibility for {v{S),S G Tq} follows from the 
existence of the essential supremum (see Theorem A.l in Appendix A). 

Take 5, S' G Tq and let A = {S = S'}. For each 9 G Ts, put 9a = 91a + 
TIac As AeJ='sn Ts', we have a.s. on A, E[(l){9)\J='s] = E[(j){9A)\Ts] = 
E[(j){9A)\J^S'] < hence taking the essential supremum over 9 G T5, 

we have v{S) < v{S') a.s., and by symmetry of S and «S", we have shown 
property 2 of admissibility. □ 

Proposition 1.2. There exists a sequence of stopping times {9^)n£N 
with 9^ in Ts such that 

E[(^{9'')\Ts] t v{S) a.s. 

Proof. For each S G Tq, one can show that the set {E[(f){9)\Ts],9 G 
r^} is closed under pairwise maximization. Indeed, let 9,9' G Tq and A = 
{E[(j){9')\Ts] < E[^{9)\J's]}. One has A G J's- Let t = 91a + 9'1a-, a stop- 
ping time. It is easy to check that E[(I){t)\Ts] = E[(l){9)\J='s]\/ E[(l){9')\J='s]. 
The result follows by a classical result (see Theorem A.l in Appendix A). 
□ 

Recall that for each fixed 5 G Tq, an admissible family {h{9),9 G Ts} is 
said to be a supermartingale system (resp., a martingale system) if, for any 9, 
9' G To such that 9 > 9' a.s., 

E[h{9)\Te'] < h{9') a.s. (resp., E[h{9)\T0>] = h{9') a.s.). 
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Proposition 1.3. 

• The value function {v{S),S G Tq} is a supermartingale system. 

• Furthermore, it is characterized as the Snell envelope system associated 
with {(l){S),S G To}, that is, the smallest supermartingale system which is 
greater (a.s.) than {(p{S) , S G Tq} . 

Proof. Let us prove the first part. Fix S > S' a.s. By Proposition 1.2, 
there exists an optimizing sequence (9^) for v{S). By the monotone con- 
vergence theorem, E[v{S)\J^s'] = li™rn-oo -E[(/>(0")|J\5'] a.s. Now, for each n, 
since ^" > 5' a.s., we have E[(l){e'')\Ts'] < v{S') a.s. Hence, E[v{S)\J^s'] < 
v{S') a.s., which gives the supermartingale property of the value function. 

Let us prove the second part. Let {v'{S),S G Tq} be a supermartingale 
system such that for each 9 G Tq, v'{6) > (j){9) a.s. Fix S G Tq. By the 
properties of v' , for aU 9 G Ts, v'{S) > E[v'{9)\Ts] > E[<j){9)\Ts] a.s. Taking 
the supremum over 9 G T5, we have v'{S) > v{S) a.s. □ 

Now, recall the following Bellman optimality criterium [see, e.g., El Karoui 
(1981)]. 

Proposition 1.4 (Optimality criterium). Fix S e Tq and let 9* G T5 
be such that E[(j){9*)] < 00. The three following assertions are equivalent: 

1. 9* is S- optimal for v{S), that is, 

(1.2) v{S) = E[cj)i9*)\Ts] a.s.; 

2. v{9*) = (j){9*) a.s. and E[v{S)] = E[v{9*)]; 

3. E[viS)]=E[cj)i9*)]. 

Remark 1.2. Note that since the value function is a supermartingale 
system, equality E[v{S)] = E[v{9*)] is equivalent to the fact that the family 
{v{9),9 G Ts^e*} is a martingale system. 

Proof of Proposition 1.4. Let us show that assertion 1 imphes as- 
sertion 2. Suppose assertion 1 is satisfied. Since the value function f is a su- 
permartingale system greater that 4>, we clearly have 

v{S) > E[v{9*)\Ts] > E[<P{9*)\J's] a.s. 

Since equality (1.2) holds, this implies that the previous inequalities are 
actually equalities. 

In particular, E[v{9*)\J^s] = E![(l){9*)\Ts] a.s., but as inequality v{9*) > 
(f){9*) holds a.s., and as E[(f){9*)] < 00, we have v{9*) = 4>i9*) a.s. 

Moreover, v{S) = E[v{9*)\J^s] a.s., which gives E[v{S)] = E[v{9*)]. Hence, 
assertion 2 is satisfied. 
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Clearly, assertion 2 implies assertion 3. It remains to show that 3 implies 1. 
Suppose that 3 is satisfied. Since v{S) > E[(p{6*)\Ts] a.s., this gives v{S) = 
E[(j){6*)\Ts] a.s. Hence, 1 is satisfied. □ 

Remark 1.3. It is clear that 

(1.3) E[v{S)] = sup E[(j){6)]. 

eaTs 

By assertion 3 of Proposition 1.4, a stopping time 0*G Ts such that E[(j){6*)] < 
oo is S'-optimal for v{S) if and only if it is optimal for the optimal stopping 
time problem (1.3), that is, 

sup E[m]= Erne*)]- 

We now give a regularity result on v [see Lemma 2.13 in El Karoui (1981)]. 
Let us first introduce the following definition. 

Definition 1.2. An admissible family {cj){9),6 G Tq} is said to be right- 
(resp., left-) continuous along stopping times in expectation [RCE (resp., 
LCE)] if for any & Tq and any sequence {6n)ni=N of stopping times such 
that On id a.s. (resp., a.s.), one has E[(/){6)] =limn~^oc E[(j){9n)]- 

Remark 1.4. If (0^) is a continuous adapted process such that 
-E[sup^g[o,T] ^t] < oo, then the family defined by 0(6*) = is clearly RCE 
and LCE. Also, if {(pt) is an RCLL adapted process such that its jumps are 
totally inaccessible, then the family defined by (j){6) = (j)g is clearly RCE and 
even LCE. 

Proposition 1.5. Let {(f>{6) , 9 & Tq} be an admissible family which is 
RCE. The family {v{S),Se Tq} is then RCE. 

Proof. Since {v{S),S G Tq} is a supermartingale system, the function 
S 1-^ E[v{S)] is a nonincreasing function of stopping times. Suppose it is 
not RCE at 5 G Tq. If E[v{S)] < oo, then there exists a constant a > and 
a sequence of stopping times {Sn)n£N such that Sni S a.s. and such that 

(1.4) lim tE[v{Sn)] + a <E[viS)]. 

n— >oo 

Now, recall that E[v{S)] = supg^^Ts E[(j){0)] [see (1.3)]. Hence, there exists 
9' G Ts such that 

sup sup E[m] + i^<E[4>{e')]. 
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Hence, for all n G N, E[(^{e' V + f < E[(t){e')]. As 0' V 5„ | 0' a.s., we ob- 
tain, by taking the limit when ?i — )■ oo and using the RCE property of 0, that 

which gives the expected contradiction in the case E[v{S)\ < oo. 

Otherwise, instead of (1.4), we have lim„_^oo t E[v{Sn)\ < C for some con- 
stant C > 0, and similar arguments as in the finite case lead to a contradic- 
tion as well. □ 

1.2. New results. We will now give a new result which generalizes the 
classical existence result of an optimal stopping time stated in the case of 
a reward process to the case of a reward family of random variables. 

Theorem 1.1 (Existence of optimal stopping times). Let {<f>{6),9 G Tq} 
be an admissible family that satisfies the integrability condition 

v{0) = sup E[(t){e)] < oo 

and which is RCE and LCE along stopping times. Then, for each S G Tq, 
there exists an optimal stopping time for v{S). Moreover, the random vari- 
able defined by 

(1.5) e*{S):=essmi{6eTs,v{e) = ^{9) a.s.} 

is the minimal optimal stopping time for v{S). 

Let us emphasize that in this theorem, the optimal stopping time 0*{S) 
is not defined trajectorially, but as an essential infimum of random vari- 
ables. In the classical case, that is, when the reward is given by an adapted 
ROLL process, recall that the minimal optimal stopping time is given by 
the random variable 9{S) defined trajectorially by 

9iS) = mi{t>S,vt = cPt}. 

The definition of 9*{S) as an essential infimum allows the assumption on 
the regularity of the reward to be relaxed. More precisely, whereas in the 
previous works (mentioned in the Introduction), the reward was given by 
an RCLL and LCE process, in our setting, the reward is given by an RCE 
and LCE family of random variables. The idea of the proof is classical: we 
use an approximation method introduced by Maingueneau (1978), but our 
setting allows us to simplify and shorten the proof. 

Proof of Theorem 1.1. The proof will be divided into two parts. 
Part I: In this part, we will prove the existence of an optimal stopping 
time. 
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Fix S* € Tq. We begin by constructing a family of stopping times [see Main- 
gueneau (1978) or El Karoui (1981)]. For A € ]0, 1[, define the J^5-measurable 
random variable 9^{S) by 

(1.6) 9^{S) := essinf{0 € Ts, Xv{9) < (j){9) a.s.}. 
The following lemma holds. 

Lemma 1.1. The stopping time 9^{S) is a {1 — X) -optimal stopping time 
for 

(1.7) E[v{S)] = sup Eimi 

e&Ts 

that is, 

(1.8) \E[v{S)]<E[^{9\S))]. 

Suppose now that we have proven Lemma 1.1. 

Since A i— )■ 9^{S) is nondecreasing, for S G Tq, the stopping time 

(1.9) e{S):=Ym^^9\S) 

is well defined. Let us show that 9[S) is optimal for v{S). 

By letting A 1 1 in inequality (1.8), and since <f) is LCE, we easily derive 
that E[v{S)] = E[(t>{G{S))\- Consequently, by the optimality criterium 3 of 
Proposition 1.4, 9{S) is S'-optimal for v{S). This completes part I. 

Part II: Let us now prove that 9*{S) = 9{S) a.s., where 9*{S) is defined 
by (1.5), and that it is the minimal optimal stopping time for v{S). 

For each S G Tq, the set Ts = {9 € Ts,v{9) = (t){9) a.s.} is not empty (sin- 
ce T belongs to Ts) and is closed under pairwise minimization. Hence, there 
exists a sequence {9n)n&n of stopping times in Ts such that 9n\r9*{S) a.s. 
Consequently, 9*{S) is a stopping time. 

Let 9 be an optimal stopping time for v{S). By the optimality criterium 
(Proposition 1.4), and since, by assumption, E\(j){9)\ < oo, we have v{9) = (f){9] 
a.s. and hence 

9*{S) < essinf{0 &To,9 optimal for i^(5)} a.s. 

Now, for each A < 1, the stopping time 9'^{S) defined by (1.6) clearly 
satisfies 9^{S) < 9*{S) a.s. Passing to the hmit when A 1 1, we obtain 9{S) < 
9*{S). As 9{S) is optimal for v{S), this implies that 9{S) > essinf}^ G To,9 
optimal for w(S')} a.s. Hence, 

9*{S)=9{S) = essinf}^ G Tq,^ optimal for v{S)} a.s., 

which gives the desired result. The proof of Theorem 1.1 is thus complete. 
□ 
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It now remains to prove Lemma 1.1. 

Proof of Lemma 1.1. We have to prove inequality (1.8). This will be 
done by means of the following steps. 

Step i : Fix A G ]0, 1[. It is easy to check that the set = {6* G Ts, Xv{9) < 
4>{6) a.s.} is nonempty (since T S T^) and closed by pairwise minimization. 
By Theorem A.l in the Appendix, there exists a sequence (^") in T5 such 
that O'' ie^{S) a.s. Therefore, e^{S) is a stopping time and e^{S) > S a.s. 
Moreover, we have \v{9'"') < (j){6'^) a.s. for all n. Taking expectation and 
using the RCE properties of v and (p, we obtain 

(1.10) XE[v{9\S)])<E[<p{9\S))]. 

Step 2: Let us show that for each A e]0, 1[ and each S £Tq, 

(1.11) v{S) = E[v{9\S))\Ts] a.s. 

For each S € Tq, let us define the random variable J{S) = E[v{9^{S))\Ts]- 
Step 2 amounts to showing that J(5) = v{S) a.s. 

Since {v{S),S € Tq} is a supermartingale system and since 9^{S) > S a.s., 
we have that 

J{S) = E[v{9^{S))\Ts]<v{S) a.s. 
It remains to show the reverse inequality. 

Step 2a: Let us show that the family {J{S),S S Tq} is a supermartingale 
system. 

Let S, S' € To be such that S' > S a.s. As 9^{S') > 9^{S) > S a.s., we have 

i?[J(5')|^5] =i^[K^'(5'))l-^5] =^[i^b(^"(5'))l-^6^M5)]l-^5] a.S. 

Now, since {v{S),S S Tq} is a supermartingale system, E[v{9^{S'))\Tg\(^s^] 
<v{9^{S)) a.s. Consequently, 

E[J{S')\Ts] < E[v{9\S))\Ts] = J{S) a.s. 

Step 2b: Let us show that for each S £Tq and each A €]0, 1[, 

\v{S) + {l-X)J{S)>^{S) a.s. 

Fix SeTo and Ae]0,l[. 

On {XviS) < (piS)}, we have 9^{S) = S a.s. Hence, on {\v{S) < (piS)}, 
J{S) = E[v{9^iS))\Ts] = E[v{S)\Ts] = viS) and therefore 

Xv{S) + {l- X)J{S) = v{S)>4>{S) a.s. 

Furthermore, on {Xv{S) > 0(5')}, as J{S) is nonnegative, we have 

Xv{S) + {l- X)J{S)>Xv{S)>4>{S) a.s.. 
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and the proof of Step 2b is complete. 

Now, the family {A?;(S') + (1 — X)J{S),S G Tq} is a supermartingale sys- 
tem by convex combination of two supermartingale systems. Hence, as the 
value function {v{S),S G Tq} is characterized as the smallest supermartin- 
gale system which dominates {0(5'), S G Tq}, we derive that for each 5 G Tq, 

Xv{S) + {l- X)J{S)>v{S) a.s. 

Now, by the integrability assumption made on (p, we have v{S) < oo a.s. 
Hence, we have J{S) > v{S) a.s. Consequently, for each S G Tq, J{S) = v{S) 
a.s., which completes Step 2. 

Finally, Step 1 [inequality (1.10)] and Step 2 [equality (1.11)] give 

XE[v{S)] = XE[v{e\S))]<E[(b{9\S))]. 

In other words, 9^{S) is a (1 — A)-optimal stopping time for (1.7), which 
completes the proof of Lemma 1.1. □ 

Remark 1.5. Recall that in the previous works [see, e.g., Karatzas and 
Shreve (1998), Proposition D.IO and Theorem D.12], the proof of the exis- 
tence of optimal stopping times requires the value function to be aggregated 
and thus the use of some fine aggregation results such as Proposition 4.1. In 
our work, since we only work with families of random variables, we do not 
need any aggregation techniques, which simplifies and shortens the proof. 

Under some regularity assumptions on the reward, we can show that the 
value function family is left-continuous along stopping times in expectation. 
More precisely, we have the following. 

Proposition 1.6. Suppose that the admissible family {(l){0) , 9 £Tq} is LCE 
and RCE, and satisfies the integrability condition ^(O) = supggjjj E[(j){9)] < oo. 
The value function {v{S),S G Tq} defined by (1.1) is then LCE. 

Proof. Let 5 G Tq and let {Sn) be a sequence of stopping times such 
that Sn^ S a.s. Note that by the supermartingale property of v, we have 

(1.12) E[v{Sn)]>E[v{S)\. 

Now, by Theorem 1.1, the stopping time 9*{Sn) defined by (1.5) is optimal 
for v{Sn)- Moreover, it is clear that {9*{Sn))n is a nondecreasing sequence 
of stopping times dominated by 9*{S). 

Let us define 9 = lim„_^oo 1 9*{Sn)- Note that is a stopping time. Also, 
as for each n, 9*{Sn) > Sn a.s., it follows that 9 > S a.s. Therefore, since (p 
is LCE, 

E[v{S)]>E[m]= hm E[(P{9*{Sn))]= lim E[v{Sn)]. 

n— ^-oo n— >oo 

This, together with (1.12), gives E[v{S)] = liiRn-^oo E[v{Sn)]- □ 
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Remark 1.6. In this proof, we have also proven that is optimal for v{S) . 
Hence, by the optimality criterium, v{9) = (j){6) a.s., which implies that 
9 > 6*{S) a.s. Moreover, since for each n, 9*{Sn) < 0*{S) a.s., by letting n 
tend to oo, we clearly have that 9 < 9*{S) a.s. Hence, 9 = lim„_>,oo t G*{Sn) 
= 9*{S) a.s. Thus, we have also shown that the map S i— )• 9*{S) is left-con- 
tinuous along stopping times. 

2. The optimal double stopping time problem. 

2.1. Definition and first properties of the value function. We now con- 
sider the optimal double stopping time problem. We introduce the following 
definitions. 

Definition 2.1. The family {ip{9,S),9,S eTo} is hiadmissihle if it sat- 
isfies: 

1. for all 9,S & Tq, 'ip{9,S) is an J^evs-™easurable M'''-valued r.v.; 

2. for ah 9,9',S,S' eTo,tp{9,S) = ij{9',S') a.s. on {9 = 9'} D {S = S'}. 

Remark 2.1. Let ^' be a biprocess, that is, a function 

^':[0,r]2 X f]^M+;(t,s,a;)h^^'t,,(a;) 

such that for almost all oj, the map {t,s) i— t- ^t,s{^^) is right- continuous 
(i.e., "^1,3 = lim(t',s')^(t+,s+) *t',s')i and for each (t,s) G [0,T]'^, ^t,s is -Ftvs- 
measurable. In this case, the family {^{9, S),9, S S Tq} defined by 

^{9,S){uj) :=^e(^),sH(6j) 

is clearly biadmissible. 

For a biadmissible family {'ip{9, S),9, S € Tq}, let us consider the value 
function associated with the reward family {■ip{9,S),9,S € Tq}: 

(2.1) viS)=ess sup E[ij{Ti,T2)\Ts]- 

Tl,T2&Ts 

As in the case of the single stopping time problem, we have the following 
properties. 

Proposition 2.1. Let {^{9,S),9,S eTo} be a biadmissible family of 
random variables. The following properties then hold: 

(1) the family {v{S), S € Tq} is an admissible family of random variables; 

(2) for each S'sTq, there exists a sequence of pairs of stopping times ((r", 
T^)).„gN in Ts X such that {Elip^Ti ,T2)\Ts]}neN is nondecreasing 
and a.s. 



E[i^{T^,Tl^)\Ts]^v{S); 
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(3) the family of random variables {v{S),S € Tq} is a super martingale sys- 
tem, that is, it satisfies the dynamic programming principle. 

Proof. (1) As in the case of single stopping time, property 1 of admissi- 
bility for {v{S),S € To} follows from the existence of the essential supremum. 

Take S, S' G Tq and put A = {S = S'}, and for each ti,T2 G Ts, put = 
Til A + T1a<: and = T2IA + TIa'^- As ^ G Fs H ^S' ^ one has, a.s. on A, 
E[i,{n,T2)\J's]=E[i:{T^,T^)\Ts] = E[^{T^,Ti)\Ts'] < v{S'). Hence, tak- 
ing the essential supremum over ti,T2 G Ts, we have v{S) < v{S') a.s., and, 
by symmetry, we have shown property 2 of admissibility. Hence, the family 
{v{S), S G Tq} is an admissible family of random variables. 

The proofs of (2) and (3) can be easily adapted from the proofs of Propo- 
sition 1.2 and Proposition 1.3. □ 

Following the case of single stopping time, we now give some regularity 
results on the value function. 

Definition 2.2. A biadmissible family {■0(6', S),6,S e Tq} is said to be 
right- continuous along stopping times in expectation (RCE) if, for any 9, 
S gTq and any sequences (0n)ngN G Tq and {Sn)neN S Tq such that On id 
and Sn i S a.s., one has E[tp{6,S)] = liuin-^oo E[ip{6n, Sn)]- 

Proposition 2.2. Suppose that the biadmissible family {Tp{6, S),9, S e 
Tq} is RCE. The family {vls), S G Tq} defined by (2.1) is then RCE. 

Proof. The proof follows the proof of Proposition 1.5. □ 

2.2. Reduction to an optimal single stopping time problem. In this sec- 
tion, we will show that the optimal double stopping time problem (2.1) can 
be reduced to an optimal single stopping time problem associated with a new 
reward family. 

More precisely, for each stopping time 6 £ Ts let us introduce the two 
J^e -measurable random variables 

(2.2) ui{9)=ess sup E[^{Ti,0)\Te], U2{9)=ess sup E[^p{9,T2)\J^e]- 

Note that since {ipiO, S),0,S G Tq} is biadmissible, for each fixed 9 G Tq, the 
families {iP{ti,6),ti G Tq} and {tp{9,T2),T2 G Tq} are admissible. Hence, by 
Proposition 1.1 the families {ui{9),9 G Ts} and {u2{6),9 G Ts} are admissi- 
ble. Put 



(2.3) 



^{9)=max.[ui{9),U2{e)]. 



MULTIPLE STOPPING 



13 



The family {(j){6),6£ Ts}, which is cahed the new reward family, is also clear- 
ly admissible. Consider the value function associated with the new reward 

(2.4) u{S) = ess sup E[(j){e) \Ts] a.s. 

Theorem 2.1 (Reduction). Suppose that {^(6*, 5), 6*, 5 G Tq} is a biad- 
missible family. For each stopping time S, consider v{S) defined by (2.1) 
andu{S) defined by (2.2), (2.3), (2.4). Then, 

v{S) = u{S) a.s. 

Proof. Let 5 be a stopping time. 

Step 1: First, let us show that v{S) < u{S) a.s. 

Let Ti, T2 G Ts. Put A = {ti < T2}. As A is in Jv^ n Jvj, we have 

E[i,{n,T2)\Ts] = E[lAE[ij{Ti,T2)\Tr,]\Ts] + E[lAcE[i;{^^ 

By noticing that on A we have E[tp{Ti,T2)\J-Ti] < U2{ti) < (f){Ti A T2) a.s. and, 
similarly, on A'^ we have E[ip{Ti,T2)\Tr2] < ui{t2) < </>(ti A T2) a.s., we get 

E[^{ri,T2)\Ts]<E[^iriAr2)\Ts]<uiS) a.s. 

By taking the supremum over ri and T2 in T5, we complete Step 1. 
Step 2: Let us now show that v{S) > u{S) a.s. 

We clearly have v{S) > esssup^^eTg E[''P{S,T2)\Ts] = U2{S) a.s. By similar 
arguments, v{S) >ui(5) a.s. and, consequently, 

v{S)>ma,x[ui{S),U2{S)]=(j){S) a.s. 

Thus, {v{S),S G To} is a supermartingale system which is greater than 
{(j){S),S G To}. Now, by Proposition 1.3, {u{S),S G Tq} is the smallest su- 
permartingale system which is greater than {(j){S),S G Tq}. Consequently, 
Step 2 follows, which completes the proof. □ 

Note that the reduction to an optimal single stopping time problem asso- 
ciated with a new reward will be the key property used to construct optimal 
multiple stopping times and to establish an existence result for them (see 
Sections 2.3-2.5). 

2.3. Properties of optimal stopping times. In this section, we are given a bi- 
admissible family {iP{6,S),6,S£Tq} such that T'[esssupg g^rp^ip{6, S)]<oo. 

Proposition 2.3 (A necessary condition of optimality) . Let S be a stop- 
ping time and consider the value function v{S) defined by (2.1) for all 6 G Ts, 
ui{6),U2{9) defined by (2.2), (p{9) defined by (2.3) and u{S) defined by (2.4). 

Suppose that the pair (rj^,r|) is optimal for v{S) and put A = {rj* < t|}. 
Then: 
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(1) r* A r| is optimal for u{S); 

(2) t| is optimal for U2{tI) a.s. on A; 

(3) T* is optimal for ui{t2) a.s. onA^. 

Moreover A = {t^ <t^}cB = {ui{tI A r^) < U2{t^ A rl)}. 

Proof. Let S £ Tq and suppose that the pah of stopping times (t^*, t|) 
is optimal for v{S). As u{S) = v{S) a.s., we obtain equahty in Step 1 of the 
proof of Theorem 2.1. More precisely, 

viS)=E[^l;iTl,T^)\Ts]=E[cl){TlAT^)\Ts]=uiS) a.s., 

E[^(Tr,r2*)|j;.] = U2{t^) = U2{t^ a rl) = 0(ri* A r^) a.s. on A, 

E[i;{T^,T^)\Tr^] = ui{t^) = ui{t; a rl) = 0(ri* A r^) a.s. on A', 

which easily leads to (1), (2), (3) and AcB. □ 

Remark 2.2. Note that, in general, for a pair (t]*,t|) of optimal stop- 
ping times for v{S), the inclusion A C B is strict. Indeed if •0 = 0, then 
V = u = ui = U2 = 4> = 0, and all pairs of stopping times are optimal. Con- 
sider = r, r| = 0. In this case, A = and B = U. 

We now give a sufficient condition for optimality. 

Proposition 2.4 (Construction of optimal stopping times). Using the 
notation of Proposition 2.3, suppose that: 

1. 0* is optimal for u{S) ; 

2. 02 is optimal for U2{9*) ; 

3. d\ is optimal for ui (9*) 

and put B = {ui{9*) <U2{0*)}. The pair of stopping times (Tj*,T|) definedhy 

(2.5) tI = 9*1b + 911bc, t^ = 9*1b + 9*1bc 

is then optimal for v{S). 

Moreover, rj* A rl = 9* and B = {t^ <t^}. 

Proof. Let 6* be an optimal stopping time for u{S), that is, u{S) = 
E[(j){9*)\J^s] a.s. Let 91 be an optimal stopping time for ui{9*) (i.e., ui{9*) = 
E[ip{9l,9*)\Tg*] a.s.) and let be an optimal stopping time for U2{9*) (i.e., 
U2{9*) = E[(f{9* ,9l)\TeA a.s.). We introduce the set B = {ui{9*) < U2{9*)} . 
Note that B is in Tq* . 

Let t]*,T2 be the stopping times defined by (2.5). We clearly have the 
inclusion 

(2.6) SCK<T2*}. 
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Since u{S) = E[^{e*)\Ts] and (p{9*) = max[ui{9*),U2{e*)], we have 

u{S) = E[lBU2{e*) + 1bcUi{9*)\Ts]. 
The optimahty of 9^ and ^2 gives that a.s. 

u{S) = E[1bH9*,9*2) + lB^i^i9l,9*)\J^s] 

= E[lBi^{T^,T^) + lB^i^{Tl,T^)\Ts]=EmTl,T^)\Ts]. 

As u{S) = v{S) a.s., the pair of stopping times (Tj*,r|) is 5-optimal for v{S). 
By Proposition 2.3, we have {rj* < t|} C B. Hence, by (2.6), B = {r* < t|}. 
□ 

Remark 2.3. Proposition 2.4 stih holds true if condition 2 holds true 
on the set B and condition 3 holds true on the set B^. 

Note that by Remark 2.2, we do not have a characterization of optimal 
pairs of stopping times. However, it is possible to give a characterization of 
minimal optimal stopping times in a particular sense (see Appendix B). 

2.4. Regularity of the new reward. Before studying the problem of the 
existence of optimal stopping times, we have to state some regularity prop- 
erties of the new reward family {(j){9) , 9 € Tq} . 

Let us introduce the following definition. 

Definition 2.3. A biadmissible family {il;{9, S),9, S e Tq} is said to 
be uniformly right- (resp., left-) continuous in expectation along stopping 
times [URCE (resp., ULCE)] if 7;(0) = sup^ ^g^^ E[V'(e, 5)] < oo and if, for 
each 9, S gTq and each sequence of stopping times (S'n)nGN such that Sni S 
a.s. (resp., Sn^' S a.s.), 

lim sup \E['iP{9, S)] - E[iP{9, 5„)] | = and 
lim sup\E['^{S,9)]- E[tl;{Sn,9)]\=0. 

The following right continuity property holds true for the new reward 
family. 

Theorem 2.2. Suppose that the biadmissible family {tp{9, S),9, S £ Tq} 
is URCE (resp., both URCE and ULCE). The family {(/)(5),5 G Tq} defined 
by (2.3) is then RCE (resp., both RCE and LCE). 

Proof. As 0(6') = max[Mi(0), 1x2(6')], it is sufficient to show the RCE 
(resp., both RCE and LCE) properties for the family {ui{9),9 € Tq}. 
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Let us introduce the following value function for each S,9 € Tq : 
(2.7) Ui{e,S) = ess svi]i E[il^{Ti,S)\Fe] a.s. 

As for ah 6'gTo, 

ui{e) = Ui{e,e) a.s., 

it is sufhcient to prove that {Ui{6, S),6, S S Tq} is RCE (resp., both RCE 
and LCE), that is, if 6,S G Tq and {6n)n, ('S'n)n in are such that On id 
and SniS a.s. (resp., Oni S and Sni S a.s.), then lim„^oo -S[C/i(0n5 •S'n)] = 
E[Ui{6,S)]. Now, we have 

\E[Ui{d,S)]-E[Ui{en,Sn)\\ 

< \E[Ui{e,s)]-E[Ui{en,s)]\ + \E[Ui{en,s)]-E[Ui{er„Sn)]\ . 

^ y \ y 

Let us show that (I) tends to as n — > oo. For each 5 € Tq, {ip{0, S),6 £ Tq} 
is an admissible family of positive random variables which is RCE (resp., 
both RCE and LCE). By Proposition 1.5 (resp., Proposition 1.6), the value 
function {Ui{0,S),9 eTo} is RCE (resp., both RCE and LCE). It follows 
that (I) converges to as n tends to oo. 

Let us show that (II) tends to as n ^ oo. By definition of the value 
function Ui{-,-) (2.7), it follows that 

\E[Ui{en,S)]-E[Ui{en,Sn)]\<snp \E[^^^{T,S)]-E[^l^{T,Sn)]\. 

which converges to since {tp{9, S),9, S S Tq} is URCE (resp., both URCE 
and ULCE). The proof of Theorem 2.2 is thus complete. □ 

Corollary 2.1. Suppose that v{0) = sup^ 5^20 i?[V'(6', 5*)] < 00. Under 
the same hypothesis as Theorem 2.2, the family {v{S),S G Tq} defined by (2.1) 
is RCE (resp., both RCE and LCE). 

Proof. This follows from the fact that v{S) = u{S) a.s. (Theorem 2.1), 
where {u{S),S G Tq} is the value function family associated with the new 
reward {(j){S) , S G Tq} . Applying Propositions 1.5 and 1.6, we obtain the 
required properties. □ 

We will now turn to the problem of the existence of optimal stopping times. 



— V — 

(11) 



2.5. Existence of optimal stopping times. Let {'(/'(^, S), 0, 5 G Tq} be a bi- 
admissible family which is URCE and ULCE. Suppose that v{0) < 00. 
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By Theorem 2.2, the admissible family of positive random variables {4>{9), 
To} defined by (2.3) is RCE and LCE. By Theorem 1.1, the stopping time 

e* = essmi{0 G Ts, u{9) = ^{9) a.s.} 

is optimal for u{S) [=f(5)], that is, 

=ess sup E[(j){9)\Ts] = E[^{0*)\Fs] a.s. 

Moreover, the families {-0(6', 0*), 6* € Tg. } and {ip{9* ,9),9 eTg*} are admis- 
sible and are RCE and LCE. Consider the following optimal stopping time 
problems defined for each S € Tq* : 

vi{S) = esssvi]i E[i;{0,e*)\Ts] and W2(S) = ess sup ^[0(^*, ^)| J's]. 
B&Ts eaTs 

By Theorem 1.1 the stopping times 9\ and ^2 defined by 9\ = essinf{0 G T0* , 
vi{e)=i){9,9*) a.s.} and 9*^ = essm{{9 ^Tg* ,V2{9) = i){0\0) a.s.} are opti- 
mal stopping times for vi{9*) and V2{9*), respectively. Note that vi{9*) = 
ui{e*) and V2{9*)=U2{9*) a.s. 

Let tI and r| be the stopping times defined by 

(2.8) tI = 9*1b + 911bc, t* = 9*1bc+9*^1b, 

where B = {u^{6*) < u^{9*)}. By Proposition 2.4, the pair (r^ ,r|) is optimal 
for v{S). Consequently, we have proven the following theorem. 

Theorem 2.3 (Existence of an optimal pair of stopping times). Let 
{tp{9, S),9, S G To} be a biadmissible family which is URCE and ULCE. Sup- 
pose that v{0) < oo. 

The pair of stopping times (t^^jtI) defined by (2.8) is then optimal for v{S) 
defined by (2.1). 

Remark 2.4. Note that since 0*, 9\, ^2 ^^^^ minimal optimal, by results 
in Appendix B, (Tj*,T2) is minimal optimal for v{S) (in the sense defined in 
Appendix B). 

3. The optimal d-stopping time problem. Let d G N, d > 2. In this sec- 
tion, we show that computing the value function for the optimal li-stopping 
time problem 

V{S) = ess SUp{£;[V'(Tl , . . . , Trf) \Ts\ ,Ti,---,TdeTs} 

reduces to computing the value function for an optimal single stopping time 
problem, that is, 

v{S) = esssup{E[(j){9)\J's],9 eTs} a.s., 

for a new reward (p. This new reward is expressed in terms of optimal {d— 1)- 
stopping time problems. Hence, by induction, the initial optimal d-stopping 
time problem can be reduced to nested optimal single stopping time prob- 
lems. 
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3.1. Definition and initial properties of the value function. 

Definition 3.1. We say that the family of random variables {ip{9),6 G 
Tq } is a d-admissihle family if it satisfies the fohowing conditions: 

1. for ah 9 = {9i, . . . ,9^) G Tq , ^{9) is an Te^y-'-ye^ measurable M^-valued 
random variable; 

2. for ah 9, 9' G Tq^, ^(0) = ^{9') a.s. on {9 = 9'}. 

For each stopping time S (zTq, we consider the value function associated 
with the reward {ijj{e),9 € T^}: 

(3.1) v{S) = ess sup E['iP{t)\Ts]- 

As in the optimal double stopping time problem, the value function satisfies 
the following properties. 

Proposition 3.1. Let {■ip{9),9 G T^} be a d-admissihle family of ran- 
dom variables. The following properties then hold: 

1. {v{S), S G To} is an admissible family of random variables; 

2. For each 5 G Tq, there exists a sequence of stopping times {9^)neN 

such that the sequence {E[ip{6'^)\Ts]}neN is nondecreasing and such that 
v{S) = limn-,oc^E[iP{e^)\Ts] a.s.; 

3. The family of random variables {v{S), S" G Tq} defined by (3.1) is a su- 
permartingale system. 

The proof is an easy generalization of the optimal double stopping time 
problem (Proposition 2.1). 

Following the case with single or double stopping time, we now state the 
following result on the regularity of the value function. 

Proposition 3.2. Suppose that the d-admissible family {iIj{9),9 ^Tq] 
is RCE and that v{Q) < oo. The family {v{S),S G Tq} defined by (3.1) is 
then RCE. 

The definition of RCE and the proof of this property are easily derived 
from the single or double stopping time case (see Definition 2.2 and Propo- 
sition 2.2). 

3.2. Reduction to an optimal single stopping time problem. The optimal 
d-stopping time problem (3.1) can be expressed in terms of an optimal single 
stopping time problem as follows. 
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For i = 1, . . . ,d and 6 gTq, consider the random variable 

tiW(0)=ess sup £'[V'(ti, . . . jTj-i, 

y-rnd— 1 

ri,...,ri_i,ri+i,...,Trfe-/g 

(3.2) 

e,Ti+i,...,Td)\J'e]- 

Note that this notation is adapted to the d-dimensional case. 
In the two-dimensional case {d = 2), we have 

u(i)(e) = ess sup E[iP{e,T2)\Te]=U2{e) a.s. 

and 

n(2)(6i) = ess sup E[il^{n,e)\Te] = ui{e) a.s., 

by definition of ui{9) and U2{0) [see (2.2)]. Thus, the notation in the two- 
dimensional case was different, but more adapted to that simpler case. 

For each 9 gTq, define the J-g-measurable random variable called the new 
reward, 

(3.3) (f){e) = max[u(^) (0),..., u^^^ {9)] , 

and for each stopping time S, define the J-5-measurable variable 

(3.4) u{S) = ess svcp E[(j){9)\Ts]. 

eeTs 

Theorem 3.1 (Reduction). Let {-0(6'),^ S Tq} be a d- admissible family 
of random variables and for each stopping time S, consider v{S) defined 
by (3.1) and u{S) defined by (3.2), (3.3) and (3.4). Then, 

v{S) = u{S) a.s. 

Proof. Step 1: Let us prove that for all S G Tq, v{S) < u{S) a.s. 

Let 5 be a stopping time and r = (ri, . . . , r^) G r|. There exists {Ai)i=i^ d 
with Q = \J-Ai, where Ai n Aj = for ^ 7^ j, ti A • • • A = a.s. on Ai and Ai 
are in J^tiA-at^ for i = 1, . . . ,d (for d = 2, one can take Ai = {ri < T2} and 
A2 = A1). We have 

d 

£;[0(r)|J-5] = J]i?[U^[0(r)|-F,J|J-5]. 

i=l 

By noticing that on Ai one has a.s. i?[i/;(r)|J>-] < u^^^Ti) < (p{Ti) = (/)(ri A 
• • • A Td), we get E['iIj{t)\J^s] < ^['/'(n A • • • A Td)\J^s] < u{S) a.s. By taking 
the supremum over r = (ti, . . . , r^), we complete Step 1. 
Step 2: Let us show that for all S G Tq, v{S) > u{S) a.s. 
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This follows from the fact that {v{S), S G Tq} is a supermartingale system 
greater than {(f){S),S G Tq} and that {u{S),S G Tq} is the smallest super- 
martingale system of this class. □ 

Note that the new reward is expressed in terms of optimal (d — l)-stopping 
time problems. Hence, by induction, the initial optimal d-stopping time 
problem can be reduced to nested optimal single stopping time problems. 
In the case of a symmetric reward, the problem reduces to ordered stopping 
times and the nested optimal single stopping time problems simply reduce 
to a sequence of optimal single stopping time problems defined by backward 
induction (see Section 3.6 and the application to swing options). 

3.3. Properties of optimal stopping times in the d-stopping time problem. 
Let {'ip{9),d G Tq} be a d-admissible family. Let us introduce the following 
notation: for i = 1, . . . ,d, GTq and ri, . . . , Td~i in Tq, consider the random 
variable 

(3.5) -ip^'Hri, . . .,Td-i,9) = tpiri, . . .,Ti-i,9,Ti, . . .,Td-i). 

Using this notation, note that for each i = 1, . . . ,d, the value function n^^'^ 
defined at (3.2) can be written 

(3.6) nW(0) = ess sup E[i:^^ {T,e)\Te]- 

Proposition 3.3 (Construction of optimal stopping times). Suppose that: 

1. there exists an optimal stopping time 6* for u{S); 

2. for i = l,...,d, there exist (0^*, . . . , ^Si*' ■ • • ' ^?*) = ^^^* 
such that u^^\e*) = E[ip^'\e(^*,e*)\Te*]. 

Let (i?i)j=i,...,d with Q = |J. Bi be such that Bi f] Bj = for i ^ j, (j){9*) = 
u'^'^\6*) a.s. on Bi and Bi is Tg* -measurable for i = 1, . . . ,d. Put 

d 

(3.7) r* = e*lB,+ J2 ^f*^^r 

Then, (rj*, . . . , r^) is optimal for v{S), and rj* A • • • A = 0*. 
Proof. It is clear that rj" A • • • A = 6**, and a.s. 

d 

u{S) = E[ct>{e*)\Ts] = E[1bM'^ {9*)\:fs] 
1=1 

d 

= Y,mB.E[^^'H0^'^*,9*)\Te*]\Ts] 
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i=l 

= El^Pirl, ...,tU,t:,t*^„.. .,T*a)\Ts] < viS) = uiS). □ 

Remark 3.1. As in the bidimensional case, one can easily derive a nec- 
essary condition for obtaining optimal stopping times. Moreover, for an 
adapted partial order relation on W^, one can also derive a characterization 
of minimal optimal d-stopping times. This result is given in Appendix B.2. 

Before studying the existence of an optimal d-stopping time for v{S), we 
will study the regularity properties of the new reward {(j){6),6 € Tq} defined 
by (3.3). 

3.4. Regularity of the new reward. Let us introduce the following defini- 
tion of uniform continuity. 

Definition 3.2. A d-admissible family {ip{9),6 G Tq } is said to be uni- 
formly right- (resp., left-) continuous along stopping times in expectation 
[URCE (resp., ULCE)] if vifi) < oo, and for each i = 1, . . . ,d, S gTq and 
sequence of stopping times {Sn)neN such that Sni S a.s. (resp., 5.„ t S a.s.), 
we have 

lim sup \E['ilj^'\e,Sn)]-E['^^''^{e,S)]\=0 a.s. 

Proposition 3.4. Let {'iIj{9),0 eT^} be a d-admissible family which 
is URCE (resp., both URCE and ULCE). The family of positive random 
variables {(p{S),S € Tq} defined by (3.3) is then RCE (resp., both RCE and 
LCE). 

Proof. The proof uses an induction argument. For d = 1 and d = 2, 
the result has already been shown. Fix d > 1 and suppose by induction 
that the property holds for any d-admissible family which is URCE (resp., 
both URCE and ULCE). Let 0^(9), 6 G r|+^} be a (d-h l)-admissible family 
which is URCE (resp., both URCE and ULCE). As (/>((9) = max[u^^\e), . . . , 
u('^+i)(6»)]^ it is sufficient to show the RCE (resp., both RCE and LCE) 
properties for the family (0), ^ € Tq} for all i = 1, . . . , d -|- 1. 

Let us introduce the following value function for each S,9 € Tq: 

(3.8) {9, S) = ess sup E[ip^^ (r, S) \Te] a.s. 

As for all 9eTo, 

u^\9) = U^\9,9) a.s., 

it is sufficient to prove that the biadmissible family {U^^\9, S),9, S € Tq} is 
RCE (resp., both RCE and LCE) as in the bidimensional case. 
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Let 9,S & and {On)n, (5'n)n be monotonic sequences of stopping times 
that converge, respectively, to 9 and S a.s. We have 

E[|i7»(0,5)-t/»(0„,5„)|] 

<E[\u^^\e,s)-u'^'Hen,s)\] + E[\u^^{en,s)-u^'Hdn,Sn)\]. 

' V ' ' V ' 

(I) (11) 

Let us show that (I) tends to as n — ?■ oo. Note that for each S" € Tq, 
(r, S), r G Tq} is a d-admissible family of positive random variables 
which is URGE (resp., both URGE and ULGE) and {C/(*)(e,5), 6 € Tq} is 
the corresponding value function family. By the induction assumption, this 
family is RGE (resp., both RGE and LGE). Hence, (I) converges a.s. to 
as n tends to oo when {9n) is monotonic. 

Let us now show that (II) tends to as n ^ oo. By definition of the value 
function U^'\-,-) (3.8), it follows that 

E[\U^'^ {9n, S) - U^^ [On, Sn) |] < sup \E[^^'^ {0 , S)] - E[i^^'^ {9, Sn)] I , 

and the right-hand side tends to by the URGE (resp., both URGE and 
ULGE) properties of ip. □ 

3.5. Existence of optimal stopping times. By Theorem 1.1, the regularity 
properties of the new reward will ensure the existence of an optimal stopping 
time 9* € Tq for u{S). By Proposition 3.3, this will allow us to show by 
induction the existence of an optimal stopping time for v{S). 

Theorem 3.2 (Existence of optimal stopping times). Let {ip{9),9 G Tq} 
be a d-admissible family of positive random variables which is URCE and 
ULCE. There then exists a t* GTg optimal for v{S), that is, such that 

v{S)=ess sup E[i;{T)\Ts] = E[i;{T*)\Ts]. 

reT| 

Proof. The result is proved by induction on d. For d = l the result is 
just Theorem 1.1. Suppose now that d > 1 and suppose by induction that 
for all d-admissible families which are URGE and ULCE, optimal d-stopping 
times do exist. Let {ip{9),9 E Tf^^} he a, {d+ l)-admissible family which is 
URCE and ULCE. The existence of an optimal {d+ l)-stopping time for the 
associated value function v{S) will be derived by applying Proposition 3.3. 
Now, by Proposition 3.4, the new reward family {(j){9),9 G Tq} is LGE and 
RGE. By Theorem 1.1, there exists an optimal stopping time 9* for u{S). 
Thus, we have proven that condition 1 of Proposition 3.3 is satisfied. 

Note now that for i = 1, . . . ,d + l, the d-admissible families {i(j^'^\9, 9*),9 £ 
Tq } are URGE and ULGE. Thus, by the induction hypothesis, for each 
9 G To, there exists an optimal 6'*(*) G T^, for the value function U^^'\9*,9*) 
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defined by (3.8). Noting that C/(*)(6l*,6'*) = n(*)(6'*), we have proven that 
condition 2 of Proposition 3.3 is satisfied. Now applying Proposition 3.3, 
the result follows. □ 

3.6. Symmetric case. Suppose that ^(ri,...,rrf) is symmetric with re- 
spect to (ti, . . . ,Td), that is, 

^(ri,...,rd) =^(T^(i),...,V(rf)) 

for each permutation a of {l,...,d}. By symmetry we can suppose that 
Ti < T2 < ■ ■ ■ < Td, that is, that the value function v{S) coincides with 

Vd{S)= ess sup ElijjiTi,. . . ,Td)\Ts], 

{Ti,...,ra)&S§ 

where Sg = {ti, . . . ,Td^Ts s.t. ti <T2 < ■ ■ ■ < Td}- It follows that the value 
functions u^^^ (6) and the new reward (j){9) coincide and are simply given for 
each 6 €Tq by the following random variable: 

(j)i{0) = ess sup E[ip{e,T2,. . . ,Td)\Tg]. 
{r2,T3,...,Ta)eSg^-^ 

The reduction property can be written as follows: 

v{S) = ess sup E[(j)i{9)\Ts]- 

e&Ts 

We then consider the value function (j)i{9i). The associated new reward is 
given for 6i , 62 such that S < 9i < 62 by 

(l)2{Oi,02) = ess sup E[il;{ei,02,T3,. . . ,Td)\Te2]- 

Again, the reduction property gives 

(3.9) <^i(0i) = ess sup E[(t)2{ei,e2)\Te,]. 

We then consider the value function 02(^1,^2)) and so on. Thus, by forward 
induction, we define the new rewards (pi for i = 1, 2, . . . , (i — 1 by 

0i(6'i,...,6'i) = ess sup E[tp{6i,...,9i,Ti+i,...,Td)\Te^] 

{Ti+i,...,rd)G<Sf~* 

for each (0i, . . . , 0j) € 5^. The reduction property gives 

(3.10) <^i(0i,...,0i)=ess sup E[^i+i{9i,...,9,,ei+i)\^e,]- 

Note that for i = d — 1 , 

(3.11) .^d_i(^i,...,0d_i) = ess sup E[^iei,...,ed^ued)\Te,_A 
for each (^i, . . . , ^^-i) e 5^^^ 
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Hence, using backward induction we can now define (pd-iif^i, - ■ ■ 
by (3.11) and then (/)d_2(^i, . . . , • • • , </'2(^i, ^2), </'i(^i) by the induction 

formula (3.10). Consequently, we have the following characterization of the 
value function and construction of a multiple optimal stopping time (which 
are rather intuitive). 

Proposition 3.5. 

• Let {ip{9),6 € Tq} he a symmetric d-admissible family of random vari- 
ables, and for each stopping time S, consider the associated value func- 
tion v{S). 

Let (pi, i = d— l,d — 2,. ..,2,1, be defined by backward induction as fol- 
lows: (f)d-i{Oi, . . . ,6(i~i) is given by (3.11) for each {61, . . . ,6d-i) & Sg~^ . 
Also, for i = d — 2, . . . ,2,1 and each {61, . . . ,6i) G S\j, (pi{6i,. . . , 9i) is given 
in terms of the function (piJ^i by backward induction formula (3.10). 

The value function then satisfies 

(3.12) v{S)=esssViV E[(t)i{e)\Ts]. 

e&Ts 

• Suppose that {ip{9),9 G T^} is URCE and ULCE. Let 01 be an optimal 
stopping time for v{S) given by (3.12), let O2 be an optimal stopping time 
for 4>i{0l) given by (3.9) and for i = 2,3, . . . ,d — 1, let 0*_^_^ be an optimal 
stopping time for (j)i{9l, . . . ,0*) given by (3.10). 

Then, [0\, . . . ,0^) is a multiple optimal stopping time for v{S). 

Some simple examples. First, consider the very simple additive case: 
suppose that the reward is given by 

(3.13) ^(ri, . . . , Td) = Y{n) + y(r2) + • • • + Y{rd), 

where Y is an admissible family of random variables such that 
sup.^g2^P £^[y(T)] <oo. We then obviously have that v{S) = dv^ (S), where v^{S) 
is the value function of the single optimal stopping time problem associ- 
ated with reward Y. Also, if 0^ is an optimal stopping time for vi{S), then 
(01, ... ,91) is optimal for v{S). 

Application to swing options. Let us now consider the more interesting 
additive case of swing options: suppose that T = +00 and that the reward is 
still given by (3.13), but the stopping times are separated by a fixed amount 
of time S > (sometimes called "refracting time"). In this case, the value 
function is given by 

v{S) = esssup{E['il){Ti, . . . ,Td)\Ts], {ti, . . . ,Td) eSg}, 

where Sg = {ri, . . . ,Td € Ts s.t. Tj G Tt-j_j+5, 2 < i < d — 1}. All the previ- 
ous properties then still hold. Again, the (pi satisfy the following induction 
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equality: 

4>i{6i,...,9i)=ess sup E[(j)i+i{0i,...,9i,9i+i)\Te^]. 

One can then easily derive that <t>d~i{9i,92, • • . , ^d-i) = Y{9i)-\ \-Y{9ci^i) + 

Zd-i{9d-i), where 

Zd-i{9d-i) = ess sup E[Y{T)\Tg^_-^]. 

<l^d-2{0i, 9a^2) = Y{9i) + ■■■ + Y{9d^2) + ^^-2(^^-2), where 
Zd-2{9d-2) = ess sup E[Y{t) + Zd~i{T)\Tea-2]i 

and so on. Hence, for i = 1, 2, . . . , d - 2, 4>i{9i, . . . ,9i) = Y{9i) ^ 'tY{9i) + 

Zi(9i), where 

Zi(6'i) = ess sup E[Y{T) + Zi+i{T)\Fe,]. 
The value function satisfies 

(3.14) v{S) = ess sup E[Y{9) + ^1(0)1^-5]. 

This corresponds to Proposition 3.2 of Carmona and Dayanik (2008). 

Suppose that Y is RCE and LCE. Let 0| be the minimal optimal stopping 
time for v{S) given by (3.14) and for i = 1, 2, . . . , d — 1, let 9*_^_l be the 
minimal optimal stopping time for Zi{9*). The d-stopping time {91,... ,6^) 
is then the minimal optimal stopping time for v{S). This corresponds to 
Proposition 5.4 of Carmona and Dayanik (2008). 

Note that the multiplicative case can be solved similarly. Further ap- 
plications to American options with multiple exercise times are studied in 
Kobylanski and Quenez (2010). 

4. Aggregation and multiple optimal stopping times. As explained in 
the Introduction, in previous works on the optimal single stopping time 
problem, the reward is given by an ROLL positive adapted process {(j)t)- 
Moreover, when the reward {(pt) is continuous, an optimal S-stopping time 
is given by 

(4.1) 9{S)=mi{t>S,Vt = q)t}, 

which corresponds to the first hitting time after S" of by the RCLL adapted 
process {vt — (pt)- This formulation is very important since it gives a simple 
and efficient method to compute an optimal stopping time. 

In the two-dimensional case, instead of considering a reward process, it is 
quite natural to suppose that the reward is given by a biprocess (^t,s)(t,s)g[o,T]2 
such that a.s., the map (t, s) (->■ is continuous and for each (t, s) S [0, T]^, 
"^t,s is /fvs-nieasurable (see Remark 2.1). 
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We would like to construct some optimal stopping times by using hitting 
times of processes. By the existence and construction properties of optimal 
stopping times given in Theorem 2.3, we are led to construct 9*, 9^ and ^2 
as hitting times of processes. Since ^' is a continuous biprocess, there is no 
problem for 91, However, for 9* we need to aggregate the new reward 
{(l){9),9 G To}, which requires new aggregation results. These results hold 
under stronger assumptions on the reward than those made in the previous 
existence theorem (Theorem 2.3). 

4.1. Some general aggregation results. 

4.1.1. Aggregation of a supermartingale system. Recall the classical re- 
sult of aggregation of a supermartingale system [El Karoui (1981)]. 

Proposition 4.1. Let {h{S),S € Tq} be a supermartingale system which 
is RCE and such that h{0) < oo. There then exists an RCLL adapted pro- 
cess (ht) which aggregates the family {h{S),S G Tq}, that is, for each S G Tq, 
hs = h[S) a.s. 

This lemma relies on a well-known result [see, e.g.. El Karoui (1981) or 
Theorem 3.13 in Karatzas and Shreve (1994); for details, see the proof in 
Section 4.4]. 

Classically, the above Proposition 4.1 is used to aggregate the value func- 
tion of the single stopping time problem. However, it cannot be applied to 
the new reward since it is no longer a supermartingale system. Thus, we will 
now state a new result on aggregation. 

4.1.2. A new result on aggregation of an admissible family. Let us intro- 
duce the following right-continuous property for admissible families. 

Definition 4.1. An admissible family {(t){9),9 G Tq} is said to be right- 
continuous along stopping times (RC) if for any 9 €Tq and any sequence 
{9n)n€N of stopping times such that 9ni9 a.s., we have (p{9) = lim„_i.oo fpif^n) 
a.s. 

We state the following result. 

Theorem 4.1. Suppose that the admissible family of positive random 
variables {(p{9),9 G Tq} is right- continuous along stopping times. There then 
exists a progressive process {(j)t) such that for each 9 ^Tq, (pg = (j){9) a.s. 
and such that there exists a nonincreasing sequence of right- continuous pro- 
cesses {(p2)n£N such that for each {tJ,t) G x [0,T], lim„_j.oo <^"(w) = 
4>t{uj). 



Proof. See Section 4.4. □ 
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4.2. The optimal stopping problem. First, recall the following classical 
result [El Karoui (1981)]. 

Proposition 4.2 (Aggregation of the value function). Let {(j){6),9 G 
To} he an admissible family of random variables which is RCE. Suppose 
that £'[esssup5)gjjj (t>{9)\ < oo. 

There then exists an RCLL supermartingale (vt) which aggregates the 
family {v{S),S € Tq} defined by (1-1), that is, for each stopping time S, 
v{S) = vs a.s. 

Proof. The family {v{S), 5 € Tq} is a supermartingale system (Propo- 
sition 1.3) and has the RCE property (Proposition 1.5). The result clearly 
follows by applying the aggregation property of supermartingale systems 
(Proposition 4.1). □ 

Theorem 4.2. Suppose the reward is given by an RC and LCE admis- 
sible family {(j){9),6 £ Tq} such that E[esssupg^rp^ 4'{G)] < oo. 

Let {(pt) be the progressive process given by Theorem 4-1 that aggregates 
this family. Let {v{S),S € Tq} be the family of value functions defined by (1.1), 
and let (vt) be an RCLL adapted process that aggregates the family {v{S),S G 
To}. 

The random variable defined by 
(4.2) e{S) = mf{t>S,vt = M 

is the minimal optimal stopping time for v{S), that is, 0{S) = 9*{S) a.s. 

As for Theorem 1.1, the proof relies on the construction of a family of 
stopping times that are approximatively optimal. The details, which require 
some fine techniques of the general theory of processes, are given in Sec- 
tion 4.4. 

Remark 4.1. In the case of an RCLL reward process supposed to be 
LCE, the above theorem corresponds to the classical existence result [see El 
Karoui (1981) and Karatzas and Shreve (1998)]. 

4.3. The optimal multiple stopping time problem. For simplicity, we study 
only the case when d=2. We will now prove that the minimal optimal pair 
of stopping times (rj*,T2) defined by (2.8) can also be given in terms of hit- 
ting times. In order to do this, we first need to aggregate the value function 
and the new reward. 

4.3.1. Aggregation of the value function. 

Proposition 4.3. Suppose the reward is given by an RCE biadmissible 
family {Tp{9, S),6, S ^Tq} such that E[esssupg^g^j-^ilj{6 , S)] <oo. 
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There then exists a supermartingale (vt) with RCLL paths that aggregates 
the family {v{S),S E Tq} defined by (2.1), that is, such for each S G Tq, 
v{S) = vs a.s. 

Proof. The RCE property of {v{S),S G Tq} shown in Proposition 2.2, 
together with the supermartingale property [Proposition 2.1(3)] gives, by 
Proposition 4.1, the desired result. □ 

4.3.2. Aggregation of the new reward. We will now study the aggrega- 
tion problem of the new reward family {(f){6),6 G Tq}. Let us introduce the 
following definition. 

Definition 4.2. A biadmissible family {^^{9, S),6, S G Tq} is said to be 
uniformly right- continuous along stopping times (URC) if £^[esssupg s&Tq V'(^) 
S)] < oo and if for each nonincreasing sequence of stopping times (5'„)„gN 
in Ts which converges a.s. to a stopping time 5 G Tq, 



lim 

n— >-oo L 



ess sup {1^(6', 5„) - ^(6*, 5)1} 



a.s. 



and 

, / ^ ^MT Q ^^^^ 



lim 

n— >oo 



ess sup {\ip{Sn, 9) -^(5,6')|} 



The following right continuity property holds true for the new reward 
family. 

Theorem 4.3. Suppose that the admissible family of positive random 
variables {ip{6, S),9, S G Tq} is URC. The family of positive random vari- 
ables {(j){S),Se To} defined by (2.3) is then RC. 

Proof. As (f){6) = max[ni(0), ti2(^)], it is sufficient to show the RC prop- 
erty for the family {ui[9),9 G Tq}. 

Now, for ah 9 G Tq, ui{9) = Ui{e,e) a.s., where 

(4.3) [/i(^,S) = ess sup ^;[^(ri,5)|J'e] a.s. 

Tl&Tg 

Hence, it is sufficient to prove that {Ui{9, S),9, S G Tq} is RC. 

Let 9,S gTq and {9n)n, {Sn)n be nonincreasing sequences of stopping 
times in Tq that converge to 9 and S a.s. We have 

\Uii9,S) - Ui{9n,Sn)\ < \Ui{9,S) - Ui{9n,S)\ + \Ui{9n,S) - Ui{9n,Sn)\. 



(I) (11) 

(I) tends to as n — > oo. 
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For each S € Tq, as {'ip{9,S),9 € Tq} is an admissible family of positive 
random variables which is RC, Proposition 4.3 gives the existence of an 
RCLL adapted process {Ul'^) such that for each stopping time 6* G Tq, 

(4.4) Ug'^ = Ui{e,S) a.s. 

(I) can be rewritten as 5) — 5)1 = —Un' | a.s., which con- 

verges a.s. to as n tends to oo by the right continuity of the process {U^ ' ). 
(II) tends to as n ^ oo. 

By definition of the value function Ui{-, •) (4.3), it follows that 
\Ui{en,S)-Ui{9n,Sn)\<E(ess sup \lP{Tl,S)-^P{n,Sn)\\Te,^ 

<E{Zm\Te„) a.s. 

for any n > m, where '■= sup^>„{esssup^gjjj \ijj{T,Sr) — tp{T,S)\} and 
{E{Zm\J^t))t>o is an RCLL version of the conditional expectation. Hence, 
by the right continuity of this process, for each fixed m G N, the sequence 
of random variables {E{Zm\J^9„))n€N converges a.s. to E{Zm\J-^e) as n tends 
to oo. It follows that for each m G N, 

(4.5) limsnp\Ui{en,S)-Ui{en,Sn)\<E{Zm\Te) a.s. 

n— >oo 

Now, the sequence {Zm)meN converges a.s. to and 
|-Z'm|<2ess sup i{j{6,S) a.s. 

Note that the second member of this inequality is integrable. By the Lebesgue 
theorem for the conditional expectation, E{Zm\J'e) converges to in 
as m tends to oo. The sequence {Zm)m<=N is decreasing. It follows that the 
sequence {E{Zm\J^e)}meN is also decreasing and hence converges a.s. Since 
this sequence converges to in L^, its limit is also almost surely. By let- 
ting m tend to oo in (4.5), we obtain 

limsup|C/i(6'„,5') - f/i(6'n,5„)| < a.s. 

n—>oo 

The proof of Theorem 4.3 is thus complete. □ 

Corollary 4.1 (Aggregation of the new reward). Under the same hy- 
pothesis as Theorem 4-3, there exists some progressive right- continuous adap- 
ted process {(pt) which aggregates the family {4>{9), 6 G Tq}, that is, cpg = (f){0) 
a.s. for each 9 gTq, and such that there exists a decreasing sequence of right- 
continuous processes ((^J*)„gN that converges to {4>t)- 

Proof. This follows from the right continuity of the new reward (The- 
orem 4.3) which we can aggregate (Theorem 4.1). □ 
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Remark 4.2. For the optimal d-stopping time problem, the same result 
holds for URC d-admissible families {tp^O), 9 G Tq}, that is, families that 
satisfy £'[esssup5ig2^jj ^(^)] < oo and 

lim ess sup | V'^*^ {9, S) - (0, 5„) | = 

for i = 1, . . . , d, 9 , S & Tq and sequences in Tq such that 5.„ i S a.s. 

The proof is strictly the same, with Ui{9,S) replaced by U^^{9,S) for 9, 
5 € To and ip{T, S) with r, € Tq replaced by V'^*^ (t, 5) , with r G Tq and 

4.3.3. Optimal multiple stopping times as hitting times of processes. As 
before, for the sake of simplicity, we suppose that d = 2. Suppose that 
{'ip{9,S),9,S e To} is a URC and ULCE biadmissible family. Let {(l){9),9e 
To} be the new reward family. By Theorem 2.2, this family is LCE. Fur- 
thermore, by Theorem 4.3, this family is RC. Let {(pt) be the progressive 
process that aggregates this family, given by Theorem 4.1. Let (ut) be an 
RCLL process that aggregates the value function associated with {(pt)- By 
Theorem 4.2, the stopping time 

9* = mf{t>S,ut = cPt} 

is optimal for u{S). 

The family {i;{9,9*), 9 £ Tg*} is admissible, RC and LCE. Let {ipl) be 
the progressive process that aggregates this family given by Theorem 4.1. 
Let {Vf) be an RCLL process that aggregates the value function associated 
with {iJjI). By Theorem 4.2 the stopping time 91 = inf{t > 9*,vl = ipj} is 
optimal for vl, and Vg, = u^{9*). 

The family {1^(9*, 9), 9 e Tg*} is admissible, RC and LCE. Let (ipf) be 
the progressive process that aggregates this family given by Theorem 4.1. 
Let (vl) be an RCLL process that aggregates the value function associated 
with (ipt)- By Theorem 4.2, the stopping time 0| = inf{t > 9*,vf = i/'t } is 
optimal for and =U2{9*). 

By Proposition 2.4, the pair of stopping times (Tj*,T|) defined by 

(4.6) tI = 9*1b + 911b^, t^ = 9*21b + 9*1bc, 

where B = {ui{9*) < U2{9*)} = {vl, < vj,}, is optimal for v{S). 

Theorem 4.4. Let {^(0, S"), 0, S G Td} be a biadmissible family which is 
URC and ULCE. The pair of stopping times (rj*,r|) defined by (4-6) is then 
optimal for v{S). 

Note that the above construction of (rf , r|) as hitting times of processes 
requires stronger assumptions on the reward than those made in Theo- 
rem 2.3. Furthermore, let us emphasize that it also requires some new ag- 
gregation results (Theorems 4.1 and 4.2). 
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4.4. Proofs of Proposition 4-1 cmd Theorems 4-i o-nd 4-2. We now give 
the proofs of Proposition 4.1 and Theorems 4.1 and 4.2. 

First, we give the short proof of the classical Proposition 4.1 which we 
recall here (for the reader's convenience). 

Proposition 4.1. Let {h{S),S G To} be a supermartingale system which 
satisfies h{0) < oo and which is right- continuous along stopping times in ex- 
pectation. There then exists an RCLL adapted process (ht) which aggregates 
the family {h{S),S G Tq}, that is, hs = h{S) a.s. 

Proof. Let us consider the process {h{t))Q<t<T- It is a supermartingale 
and the function 1 1-^ E{h{t)) is right-continuous. By classical results [see 
Theorem 3.13 in Karatzas and Shreve (1994)], there exists an RCLL super- 
martingale {ht)o<t<T such that for each t G [0,T], ht = h{t) a.s. It is then 
clear that for each dyadic stopping time S £ Tq, hs = h{S) a.s. (for details, 
see Part 2 of the proof of Theorem 1.1). This implies that 

(4.7) E[hs] = E[h{S)]. 

Since the process (/ij)o<t<T is RCLL and since the family {h{S),S G Tq} is 
right-continuous in expectation, equality (4.7) still holds for any stopping 
time 5 G Tq. It then remains to show that hs = h{S) a.s., but this is classical. 
Let A G Ts and define Sa = SIa + Tl^c. Since Sa is a stopping time, 
E[hsJ = E[h{SA)]- Since hr = h{T) a.s., it gives that E[h si a] = E[h{S)l a], 
from which the desired result follows. □ 

We now give the proof of Theorem 4.1. 

Theorem 4.1. Suppose that the admissible family of positive random 
variables {(j){6),6 G Tq} is right- continuous along stopping times. There then 
exists a progressive process {(pt) such that for each 6 G Tq, (j)g = (j)[6) a.s. 
and such that there exists a nonincreasing sequence of right- continuous pro- 
cesses {(j)f)n<=N such that for each {uj,t) £ Q x [0,T], lim.n^oo^l^t'i^) — 4't{^)- 

Proof. For each n G N*, let us define a process ((/'")t>o that is a function 

of {uj,t) by 

(4.8) (Pt{<^)= sup ^{sAT) 

seiD)n]t,([2"t]+i)/2"[ 

for each {uj,t) G x [0,T], where D is the set of dyadic rationals. 

For each t G [0,r] and each e > the process ((/>") is (Jt+e)-adapted 
and, for each a; G fi, the function 1 1-)- (pf{uj) is right-continuous. Hence, the 
process (</>") is also (/t+e)-progressive. Moreover, the sequence {(j)t')neN* is 
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decreasing. Let cpt be its limit, that is, for each {uj,t) £Q x [0,T], 

(t)t{uj) = Hm (t>t{u}). 

71— >00 

It follows that for each e > 0, the process {(pt) is (J-(+e)-progressive. Thus, 
{(pt) is (J^f+)-progressive and consequently (J^f) -progressive since Tt+ = Ft- 
Step 1 : Fix 6 € Tq. Let us show that (pg < (j){9) a.s. 

Let us suppose, by contradiction, that the above inequality does not hold. 
There then exists e > such that the set A = {(j){0) < (pe — e} satisfies 
P{A) > 0. 

Fix n £ N. For all uj £ A, we have that (j){9){uj) < — e, where 

'^e(a;)('^) defined by (4.8) with t replaced by 9{uj). 

By definition of there exists t £]e{uj),^^-^^^[nB such that 

0(^)H<<A(t)H-|. 
We introduce the following subset of [0, T] x 0,: 

[2''e{oj)] + 1 



Ar, 



2" 



nB and (t>{e){uj) < (w) 



First, note that An is optional. Indeed, we have An = \Jt^o{t} x Bn,t, where 

[2''e] + 1 ■ 



n,t 



<t< 



2" 



n m < m 



and the process {u},t) ^ is optional since 9 and - — :^r— are stopping 

times and {(j){9).,9 € Tq} is admissible. Also, A is included in 7r(A„), the 
projection of An onto il, that is, 

A C -KiAn) = G 3t G [0, T] s.t. (t, uj) e 'An}. 

Hence, by a section theorem [see Dellacherie and Meyer (1975), Chapter IV], 
there exists a dyadic stopping time T„ such that for each oj in {T„ < od], 
{Tn{uj),uj) € An and 

P{Tn < oo) > P{n(An)) P{A) ^^^^ 



Hence, for all a; in {T„ < oo} 



cP{9){u)<^{Tn{uj))-- and r„(a;) G 



2n+l ■ 

[2"^(l^)] + 1 



ni 



Note that 



p(n(r„<»,),P(.)-(E^).^>o. 
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Put r„ = Ti A • • • A r„. We have r„ 1 6* and 0(6*) < 0(r„) - § for each n on 
C\n>i{'^n < oo}. By letting n tend to oo in this inequahty, since {(j){9),6 £ Tq} 
is right-continuous along stopping times, we derive that (j){9) < (j){0) — | 
a.s. on {^nyi{Tn < oo}, which gives the desired contradiction. 

Step 2: Fix 9 € Tq. Let us show that (j){9) < (j)Q a.s. 

Put T" = . The sequence (T") is a nonincreasing sequence of stop- 

ping times such that T" J, 9. Moreover, note that since the family {(i){9), 
€ To} is admissible, for each d E D, for almost every ui G {r'^+i = c?}^ 
(/.(r"+i)(a;) = (/)(d)(a;).Now, we have r"+iG]6',r"[n D. Also, for each w G 17 
and each d G](9(a;),r"(u;)[nD, 

< sup (l){s){u) = 4/^,.(u), 
se]0(w),T"(w)[nici) 

where the last equality follows by the definition of 4>^qi^^^{'^) [see (4.8), with t 
replaced by ^(w)]. Hence, 

Letting n tend to oo, by using the right-continuous property of {4>{9).,9 G Tq} 
along stopping times and the convergence of to 4>0[uj){oj) for each oj, 

we derive that 0(0) < (f)g a.s. □ 

We now give the proof of Theorem 4.2. 

Theorem 4.2. 9{S)=mi{t > S,vt = (j)t} is an optimal stopping time for vs- 

Proof. We begin by constructing a family of stopping times that are 
approximatively optimal. For A g]0, 1[, define the stopping time 

(4.9) 9^{S):=mf{t>S,Xvt<^t}/\T. 

The proof follows the proof of Theorem 1.1 exactly, except for Step 1, which 
corresponds to the following lemma. 

Lemma 4.1. For each S e Tq and X e]0,l[, 

(4.10) Xv-^x^^^<^-^x^^^ a.s. 

By the same arguments as in the proof of Theorem 1.1, 9^{S) is nonde- 
creasing with respect to A and converges as A 1 1 to an optimal stopping 
time which coincides with 9{S) a.s. □ 

Proof of Lemma 4.1. To simplify notation, 9^{S) wiU be written 

as 9'^ . For the sake of simplicity, without loss of generality, we suppose that 
1 1-^- vt{uj) is RCLL for each to Gil. 
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Fix (x> G $7. In the following, we use only simple analytic arguments. 
By definition of 9^{u)) (1.6), for each n G N*, there exists t G [9^ {uj) , 6''' (uj) + 
^[ such that Xvt{uj) < 4>t{(^)- 

Also, note that for each m G N*, (pti^) ^ (PTi^)- 
Now, fix m G N* and a > 0. 

By the right continuity of 1 1— )• vt{i^j) and 1 1-^ (j)Y^{u)), there exists t^{uj) G 

nn[e^{uj),e^{u) + i[ such that 

(4.11) Xvtrn^^){uj)<<P'^^^^{uj) + a. 

Note that lim„^oo iJI^('^) = 9^{^) and f^iu)) > 9^{uj) for any n. Again, by 
using the right continuity of t vt{uj) and 1 1— > (f)i^{oj), and by letting n tend 
to oo in (4.11), we derive that 

and this inequality holds for each a > 0, m G N* and a; G il. By letting m 
tend to oo and a tend to 0, we derive that for each a; G $7, Xv-^x, Aoj) < 

(uj) ^ ' 

, (w), which completes the proof of the lemma. □ 



APPENDIX A 

We recall the following classical theorem [see, e.g., Karatzas and Shreve 
(1998), Neveu (1975)]. 

Theorem A. 1 (Essential supremum). Let {Vt, J-", P) he a probability space 
and let X be a nonempty family of positive random variables defined on 
{Q,J-,P). There exists a random variable X* satisfying: 

1. for allXeX, X<X* a.s.; 

2. if Y is a random variable satisfying X <Y a.s. for all X ^ X , then 
X* <Y a.s. 

This random variable, which is unique a.s., is called the essential supremum 
of X and is denoted ess sup 

Furthermore, if X is closed under pair wise maximization (i.e., X,Y ^X 
implies X y Y ^ X ), then there is a nondecreasing sequence {Zn}n£f^ of 
random variables in X satisfying X* =lim„_>.oo^n o,-s. 
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APPENDIX B 

B.l. Characterization of minimal optimal double stopping time. In or- 
der to give a characterization of minimal optimal stopping times, we intro- 
duce the following partial order relation on M?: {a,b) -< {a',b') if and only if 

[(a A 6 < a' A b') or (a A 6 = a' A 6' and a<a' and b < b')]. 

Note that although the minimum of two elements of M? is not defined, 
the infimum, that is, the greatest minorant of the couple, does exist and 

inf[(a,6), (a',6')] = l{aAb<a'Afe'}("i ^) + l{a'Afe'<aAfe}("'i + l{aAfe=a' Afe'} ^ 

a',bAb'). 

Note also that if (Tj*,T|), {t{,T2) GTqxTq are optimal for v{S), then the 
infimum of the couple inf[(Tj*,T|), {t[,T2)], in the sense of the relation ~< a.s., 
is optimal for v{S). 

The two following assertions can be shown to be equivalent: 

1. a pair (Tj*,r2) GTqxTq is minimal optimal for v{S) (i.e, is the minimum 
for the order ^ a.s. of the set {{t^,t^) € T|, v{S) = E['iP{tI,t^)\Ts]}), 
9* = Tf A rl and 9^, S Tq are such that 6*2 = r| on {rf < and 
9l=T^on K>r|}; 

2. (a) 9* € To is minimal optimal for u{S); 

(b) ^2 ^ ^0 is minimal optimal for ^2(6**) on {ui{9*) <U2{9*)}; 

(c) 91 e To is minimal optimal for ui{9*) on {u2{9*) <ui{9*)}, and rj* = 

^*l{«i(9*)<«2(e*)} + ^il{«i(6i*)>«2(6'*)}' "^2 = ^*l{«2{e*)<«i{e*)} + 6*2 x 
l{«2(e*)>«i(e*)}- 

B.2. Characterization of minimal optimal d-stopping times. Consider 
the following partial order relation -<d on M"^ defined by induction in the 
following way: for d= 1, Va,a' G M, a ~<i a' if and only if a < a' , and for 
d>l, y{ai,. . . ,ad),{a[,. . . ,a'j) € M'^, (oi, . . . , a<i) {a[,...,a'j) if and only 
if either oi A • • • A < a'^^ A • • • A or 

ai A ■ ■ ■ A ad = a'l A • ■ ■ A a'^, and, for i = 1, . . . , d, 

{a ■ = a'^ A • • • A and 
(ai, . . . ,aj_i,aj+i, ...,ad) 
-<d-i (a'l , . . . , a^_i, a^+i, • • • , a'^) . 

Note that for d = 2 the order relation ^2 is the order relation -< defined 
above. 

One can show that a d-stopping time (ti, . . . , t^) is the d-minimal optimal 
stopping time for v{S), that is, it is minimal for the order in the set 
{r € TI,v{S) = E['iIj{t)\Ts]} if and only if: 

1. 9* = Ti A ■ ■ ■ A Td IS minimal optimal for u{S); 

2. for i = 1, . . . , d, 6**^*) = Tj € is the {d — l)-minimal optimal stopping 
time for ti»(6l*) on the set {u^''^{9*) > Vfc^i ^^^'^H^'*)}- 
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